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ABSTRACT 

This  report  investigates  a  problem  that  arises  in  the  precise  registration  of 
images  viewed  from  a  moving  wide  field  imaging  sensor,  such  as  an  airborne 
missile  threat  warner.  It  analyses  the  geometry  and  radiometry  of  image  forma¬ 
tion  by  idealised,  but  otherwise  arbitrary,  imaging  optics,  thereby  determining 
the  image  plane  irradiance  distribution.  The  analysis  extends  to  determin¬ 
ing  the  transformation  of  the  irradiance  (i.e.  image  warping)  due  to  arbitrary 
displacement  of  the  optical  system;  such  image  warping  being  separable  into 
geometric  (i.e.  image  point  shift)  and  radiometric  (i.e.  intensity  scaling)  com¬ 
ponents.  Numerical  simulations  demonstrate  the  severity  of  the  radiometric 
warping  for  wide  field  images — an  especially  important  result,  since  radiometric 
warping  is  conventionally  neglected  in  image  registration.  Exact  solutions  for 
the  warping  due  to  pure  rotation  of  an  idealised  imager  are  presented.  These 
are  completely  independent  of  the  scene.  An  examination  of  the  inclusion  of 
imager  translation  shows  that  the  warping  becomes  formally  dependent  on  the 
scene  topography,  and  emission/scattering  directionality.  Simulations  of  the 
use  of  block  matching  to  achieve  approximate  registration  are  presented. 
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Geometric  and  Radiometric  Image  Warping 
due  to  Displacement  of  Wide  Field  Optical  Systems 


EXECUTIVE  SUMMARY 

For  quite  some  time,  Land,  Space  and  Optoelectronics  Division  has  maintained  an 
ongoing  research  programme  on  electro-optic  missile  threat  warners.  This  has  involved 
exploration  and  development  of  possible  new  forms  of  threat  warner,  as  well  as  assessment 
of  existing  systems.  As  a  further  contribution  to  this  research  effort,  this  report  addresses 
an  important  problem  that  arises  in  threat  warning  systems  based  on  the  detection  of 
changes  (due  to  motion  of  an  approaching  missile  against  the  background)  in  wide  field 
images  acquired  by  passive  sensors.  The  problem  of  concern  is  that  of  the  need  for  pre¬ 
warping  of  image  geometries  and  intensities,  prior  to  image  subtraction  for  the  purposes 
of  accentuating  real  changes  in  the  scene. 

The  following  airborne  threat  warning  system  is  considered.  An  aircraft  is  fitted  with 
a  downward  looking,  very  wide  field  imager.  Images  consist  of  the  landscape  beneath  the 
aircraft,  and  possibly  an  approaching  missile.  Consecutive  images  are  subtracted  from 
one  another  to  eliminate  the  stationary  background  clutter,  but  leave  a  signature  at  the 
location  of  the  fast  moving  missile. 

A  fundamental  problem  with  this  missile  detection  scheme  for  an  imager  mounted 
directly  on  the  airframe,  is  that  the  imager  wobbles  as  the  aircraft  rolls,  pitches  and  yaws. 
Consecutive  images  will  therefore  correspond  to  different  orientations  of  the  imager,  so 
that  direct  subtraction  of  images  will  not  completely  eliminate  the  background  clutter. 
It  is  necessary  to  transform  images  to  a  common  imager  reference  frame  (i.e.  the  images 
must  be  registered),  before  they  are  subtracted. 

Wide  field  imaging  has  two  peculiarities  that  are  either  nonexistent  or  not  apparent 
in  the  narrow  field  perfect  imaging  case  that  is  usually  assumed.  The  first  is  that  wide 
field  imaging  optics  are  deliberately  designed  to  be  geometrically  distorting,  to  keep  the 
image  size  within  the  limits  of  a  focal  plane  detector.  Narrow  field  optics  generally  have 
negligible  geometric  distortion.  The  second  peculiarity  is  that  the  radiometric  (i.e.  inten¬ 
sity)  distortion  that  is  generally  present  in  any  imaging  system,  only  becomes  significant 
at  large  field  angles,  hence  it  is  only  significant  in  wide  field  images. 

This  report  analyses  idealised  wide  field  imaging  optics  to  describe  how  object  position 
and  radiance  are  transformed  into  the  image  plane,  and  how  this  transformation  varies 
with  arbitrary  displacement  of  the  optical  system.  It  is  this  variation  of  the  transformation 
with  optical  system  displacement  that  gives  rise  to  the  need  for  registration  of  images  by  a 
warping  operation.  Furthermore,  simulations  demonstrate  that  a  radiometric  transforma¬ 
tion  (pixel  intensity  transformation)  is  required  in  addition  to  a  geometric  transformation 
(pixel  position  transformation)  in  order  to  achieve  registration. 

For  pure  rotation  of  the  imaging  sensor,  the  report  shows  that  the  exact  solution  for 
the  geometric  and  radiometric  warping  needed  to  register  two  images  depends  on  only 
the  sensor  motion  and  optical  characteristics,  but  not  on  any  scene  properties.  From  an 
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imaging  perspective,  the  condition  of  pure  rotation  is  a  close  approximation  to  the  actual 
motion  of  a  slow  or  high  flying  aircraft,  or  a  particularly  unsteady  one.  If  the  sensor  also 
undergoes  translation,  the  report  reveals  how  the  exact  solution  also  depends  on  the  scene 
topography  and  its  directionality  of  emission  or  scattering. 

Simulations  of  block  matching  approximations  to  the  exact  registration  problem  are 
presented.  Block  matching  entails  partitioning  one  image  into  an  array  of  subimages,  and 
registering  each  subimage  with  the  other  image  by  simple  translation  only.  At  least  for 
the  present  example,  it  seems  that  block  matching  can  accommodate  geometric  warping 
quite  well,  but  less  so  for  radiometric  warping.  A  meaningful  measure  of  the  precision 
achieved  by  any  approximate  registration  algorithm  depends  on  the  scene  as  well  as  the 
optical  system  and  its  displacement.  An  average  precision  value  will  require  testing  of  the 
approximate  algorithm  on  a  large  ensemble  of  scenes,  or  alternatively,  a  statistical  analysis 
based  on  good  stochastic  models  for  the  radiance  and  surface  variation  of  the  scene. 
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1  Introduction 

The  research  reported  here  was  motivated  by  a  problem  that  arose  in  a  previous  pro¬ 
posal  for  a  passive,  airborne  missile  approach  warning  system  (Caprari  [1]).  The  concept 
underlying  this  proposal  is  to  have  an  imaging  sensor  view  the  scene  below  the  aircraft. 
Consecutive  images  would  be  carefully  registered,  both  geometrically  and  radiometrically 
(i.e.  in  intensity),  so  that  subtraction  of  the  images  would  in  principle  leave  a  residual  only 
where  a  fast  moving  missile  is  located.  Image  registration  is  the  process  of  transforming 
two  images  of  ostensibly  the  same  scene,  so  that  a  given  object  point  appears  at  the  same 
image  point  and  with  the  same  intensity  in  both  images.  It  is  envisaged  that  the  imaging 
system  required  for  passive  threat  warning  would  have  simultaneous  coverage  of  almost 
all  of  the  hemisphere  below  the  aircraft,  that  is,  a  field  of  view  approaching  180°.  The 
imaging  system  is  assumed  to  be  mounted  directly  on  the  airframe,  without  a  gyroscop- 
ically  stabilised  mount.  Consequently,  the  optical  axis  of  the  imaging  system  rotates  as 
the  aircraft  rolls,  pitches  and  yaws,  with  the  result  that  consecutive  images  are  warped 
relative  to  each  other. 

The  fundamental  problem  in  this  type  of  passive  missile  detection  scheme  is  one  of 
registration  of  consecutive  images  obtained  by  a  system  that  both  translates  and  rotates  in 
the  time  period  between  the  acquisition  of  the  two  images.  And  the  precision  of  registration 
demanded  by  this  missilie  detection  scheme  is  extreme.  In  fact,  the  simulations  contained 
in  the  report  on  this  scheme  by  Caprari  [1]  assume  perfect  image  registration,  and  yet 
the  missile  detection  capability  of  this  scheme  is  still  only  assessed  as  being  marginal. 
Furthermore,  the  missile  detection  capability  declines  with  declining  precision  of  image 
registration. 

This  report  presents  the  exact  solution  to  this  problem,  for  an  idealised  wide  field 
imager  with  known  motion.  The  exact  geometric  transformation  between  images  is  shown 
to  be  of  such  complexity  that  it  can  not  be  represented  by  a  global  image  translation,  which 
is  an  often  used  approximation.  Furthermore,  the  exact  radiometric  transformation,  which 
is  often  neglected  in  image  registration,  will  be  seen  to  be  significant  for  the  wide  field 
images  of  interest  in  passive  airborne  missile  threat  warning. 

As  an  approximation  to  the  exact  image  transformation,  this  report  examines  the  par¬ 
titioning  of  one  of  the  images  into  subimages,  and  independently  registering  each  subimage 
with  the  other  image,  using  only  translation  and  intensity  scaling.  Such  an  approach  to 
image  registration  would  be  appropriate  if  the  parameters  specifying  the  exact  transforma¬ 
tion,  being  the  Euler  angles  of  imaging  system  rotation  in  this  case,  were  not  known  with 
sufficient  precision.  Estimation  of  the  translation  and  intensity  scaling  parameters  is  done 
on  the  basis  of  minimising  the  difference  between  the  transformed  subimage  and  the  other 
image,  using  an  iterative  procedure.  The  best  estimate  would  in  principle  depend  on  the 
content  of  the  image,  whereas  the  exact  transformation  does  not.  Although  a  global  image 
translation  and  intensity  scaling  is  a  poor  approximation  to  the  exact  transformation,  it 
will  be  seen  that  the  same  type  of  approximation  independently  applied  to  sufficiently 
small  subimages  can  be  a  reasonably  good  approximation.  The  importance  of  this  re¬ 
sult  is  that  it  implies  that  even  if  imaging  system  orientation  information  is  not  available 
in  a  proposed  missile  detection  system,  the  likelihood  is  that  sufficiently  precise  image 
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registration  can  still  be  undertaken  by  a  conceptually  simple  approximation  procedure. 

Fundamentally,  this  report  seeks  to  quantify  how  a  changing  optical  system  disposition 
relative  to  the  scene  influences  the  way  that  scene  is  imaged,  with  particular  emphasis  on 
wide  field  imaging.  Such  information  is  of  critical  importance  for  the  effective  and  precise 
geometric  and  radiometric  registration  of  sequences  of  images.  In  addition  to  the  appli¬ 
cation  that  has  motivated  this  report,  this  operation  is  important  in  applications  such 
as:  temporal  noise  suppression  by  image  summation  (temporally  white  noise  is  reduced 
by  a  factor  of  y/N  by  summing  N  images);  change  detection  by  image  subtraction  (the 
consequences  of  inaccurate  image  registration  on  the  reliability  of  change  detection  have 
been  investigated  by  Townshend  ei  al  [2]);  and  computer  based  image  stabilisation  for  pre¬ 
sentation  on  a  display  as  a  substitute  for  mechanical  stabilisation  of  the  imaging  platform 
(see  Bonshtedt  et  al  [3]  and  references  therein). 

The  contents  of  this  report  are  summarised  as  follows.  Section  2  introduces  the  no¬ 
tion  of  imaging  characteristic,  related  to  the  distortion  aberration  of  image  formation, 
and  specifies  a  feasible  imaging  charcteristic  for  a  wide  field  imaging  system.  Section  3 
discusses  the  kinematics  of  rotation,  and  the  Euler  angles  parametrisation  of  rotation. 
Section  4  presents  the  formal  expression  for  allowable  image  transformations,  from  which 
it  is  evident  that  any  transformation  naturally  separates  into  a  geometric  and  radiometric 
(intensity)  component.  Section  5  analyses  the  geometric  warping  resulting  from  camera 
rotation,  and  includes  simulation  results.  Section  6  analyses  the  radiometric  warping  re¬ 
sulting  from  camera  rotation,  and  includes  simulation  results.  Section  7  indicates  how 
the  preceding  analyses  are  modified  to  include  camera  translation  also,  and  discusses  the 
ensuing  complications  for  both  warping  components. 

This  report  is  an  enhanced  version  of  an  article  published  by  the  author  in  the  open 
literature  (Caprari  [4]). 


2  Imaging  characteristic 

Consider  an  axially  symmetric  optical  system.  The  image  formation  of  the  optical 
system  is  assumed  to  be  stigmatic  for  all  object  points  (depth  of  field  extends  over  the 
complete  radial  distance  variation  of  the  object),  hence  the  only  permissible  aberrations 
are  curvature  of  field  and  distortion.  Curvature  of  field  is  assumed  to  be  absent,  thus 
leaving  distortion  as  the  only  aberration.  The  imaging  geometry  of  an  arbitrary  optical 
system  of  this  type  is  illustrated  in  Figure  1. 

Image  distortion  is  quantified  by  expressing  the  relation  between  0,  the  polar  angle  of 
the  object  point  measured  with  respect  to  the  optical  axis,  and  p,  the  radial  distance  of 
the  image  point  from  the  centre  of  the  image  plane; 

p  =  F{9)  ,  for0>O  .  (1) 
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The  origin  of  the  vertex  measured  by  9  is  the  (real  or  virtual)  intersection  of  the  object 
space  chief  ray  with  the  optical  axis;  for  an  aperture  stop  centred  on  the  optical  axis,  this  is 
just  the  centre  of  the  entrance  pupil.  One  will  appreciate  from  the  analysis  of  radiometric 
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Figure  1:  The  geometry  of  image  formation  by  an  arbitrary  axially  symmetric  optical 
system  whose  only  aberration  is  distortion.  For  a  multi- component  optical  system,  the 
vertex  about  which  9  is  measured  is  actually  the  centre  of  the  entrance  pupil. 


warping  in  Section  6  why  the  origin  of  object  space  is  chosen  to  be  the  centre  of  the 
entrance  pupil,  rather  than  one  of  the  cardinal  points  of  the  optical  system.  Conjugate 
object  and  image  points  are  located  in  the  same  meridional  plane,  which  also  contains  the 
optical  axis.  One  may  arrange  the  object  space  and  image  plane  coordinate  systems  so 
that  the  object  point  azimuthal  angle  (j)  equals  the  image  point  azimuthal  angle  a,  that  is, 

a  =  <j>  .  (2) 

One  may  introduce  the  term  imaging  characteristic  of  the  optical  system  (not  to  be  con¬ 
fused  with  a  Hamiltonian  characteristic  function)  to  denote  the  function  F{9).  F{6)  cer¬ 
tainly  would  be  monotonically  increasing  from  F(0)  =  0  for  any  sensible  imaging  system. 

The  perfect  imaging  approximation,  in  which  there  is  no  image  distortion,  corresponds 
to  the  imaging  characteristic, 

^perfectC^')  = /tan6>  (perfect  imaging)  ,  (3) 

where,  for  an  object  effectively  at  infinity,  /  is  the  focal  length  of  the  optical  system.  This 
imaging  characteristic  is  both  atypical  and  undesirable  for  very  wide  angular  field  of  view 
optical  systems  (2^max~100°).  It  is  particularly  undesirable  in  circumstances  where  the 
optical  system  has  an  area  photodetector  without  mechanical  scanning,  where  there  are 
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Figure  2:  Visual  representation  of  the  imaging  characteristic  F{6)=fd,  where  f  is  chosen 
to  give  unity  central  magnification,  and  the  four  vertices  of  the  object  grid  correspond  to 
the  polar  angle  6  =  72°.  The  small  filled  circle  indicates  the  position  of  the  optical  axis 
(which  is  normal  to  both  object  and  image),  that  is,  6  =  0.  The  observable  barrel  distortion 
deviates  from  Seidel  distortion. 


severe  constraints  on  the  maximum  size  of  the  photodetector  (eg.  monolithic  focal  plane 
array).  In  such  a  situation  there  is  an  inherent  incompatibility  between  the  asymptotically 
infinite  image  area  arising  from  (3),  and  the  finite  and  small  area  photosensitive  region  in 
the  image  plane. 

An  imaging  characteristic  that  alleviates  this  problem  by  producing  smaller  images, 
and  one  that  is  more  representative  of  actual  wide  field  of  view  optical  systems,  is, 

(actual  imaging)  ,  (4) 

where  the  object  point  polar  angle  6  is  expressed  in  radians.  Examples  of  imaging  systems 
that  conform  to  imaging  characteristic  (4)  include  some  fish  eye  lenses  (Miyamoto  [5], 
Kingslake  [6,  Secs.  6. II. A  and  15.V.C]),  the  Zeiss  Pleon  lens  (Gardner  and  Washer  [7]), 
and  several  contemporary  designs  (eg.  Kawamura  [8],  Hayashida  [9]).  The  image  distortion 
associated  with  imaging  characteristic  (4)  is  illustrated  in  Figure  2,  for  the  special  case  of 
unity  central  magnification  and  angular  field  of  view  2^max  =  144°.  Inspection  of  Figure  2 
immediately  reveals  that  imaging  characteristic  (4)  exhibits  barrel,  or  positive,  distortion. 
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The  geometric  distortion  ^{0)  of  an  arbitrary  imaging  characteristic  is  its  deviation 
from  the  perfect  imaging  characteristic,  that  is, 


ZV(0)  =  F(0)-/’perfectW 


(5) 


For  the  presently  assumed  imaging  characteristic,  one  has  from  (3)  and  (4), 

=  fO  —  f  tan^  , 

=  -W-ye^  +  o{e-^)  (|0i<|)  , 

^  +  (|0|<|).  (6) 

Since  primary,  or  Seidel,  distortion  has  the  form  (see  any  geometrical  optics  textbook), 

Z!sseidel;c(^)  oc  tan^^  (Seidel  distortion)  ,  (7) 

one  observes  from  (6)  that  the  actual  distortion  associated  with  imaging  characteristic  (4) 
deviates  from  Seidel  distortion. 

Given  an  arbitrary  imaging  optical  system,  it  is  a  relatively  simple  matter  to  measure 
experimentally  its  imaging  characteristic  F{6)  (see  Shah  and  Aggarwal  [10],  and  references 
therein). 


3  Optical  system  rotation 

Consider  the  aircraft  initially  pointing  along  the  x-axis,  the  right  wing  approximately 
pointing  along  the  y-axis,  and  the  downward  directed  imager  optical  axis  pointing  along 
the  z-axis  (Figure  3).  Rotation  of  the  aircraft  and  imaging  system  is  specified  by  the 
three  independent  Euler  angles  (p,  &  and  ip  (Goldstein  [11,  Sec.  4-4  and  App.  Bj),  defined 
according  to  the  following  convention: 

1.  The  first  rotation  is  by  angle  (p  around  the  original  z-axis  {yaw  or  heading). 

2.  The  second  rotation  is  by  angle  0  around  the  intermediate  y-axis  {pUch  or  aUitude). 

3.  The  third  rotation  is  by  angle  ip  around  the  final  x-axis  {roll  or  bank). 

The  orientation  of  the  aircraft  and  imaging  system  changes  from  being  aligned  with 
axes  (x,  y,  z)  to  being  aligned  with  axes  (x',  y',  z').  Such  a  rotation  is  defined  by  specific 
values  of  Euler  angles  (p,  9  and  ip.  The  linear  transformation  between  the  cartesian  co¬ 
ordinates  of  an  invariant  object  space  point  in  the  initial  and  final  reference  frames  is 
expressed  by, 

r'  =  T{<PJ,iP)r  ,  (8) 
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Figure  3:  Cartesian  coordinates  defined  with  respect  to  an  aeroplane  carrying  an  imaging 
system  with  optical  axis  along  the  z-axis.  The  origin  coincides  with  the  centre  of  the 
entrance  pupil  of  the  optical  system. 


where  r  implicitly  represents  the  column  vector  of  cartesian  coordinates,  and  the  rotation 
matrix  T  is, 


cos(/)  cosd 
coscf)  sin^sin^’  — 
sincf)  cosip 
coscf)  sin0  cos^+ 
sincpsinif) 


sincf)  cosd 
sin^  sin0  sinv^+ 
coscj)  cosip 
sincf)  sin^  cosip  — 
coscf)  sin^ 


cosd  sin^ 


cos^  cosip 


The  linear  transformation  represented  by  T  is  a  proper  orthogonal  transformation,  that 
is. 


T-i  ^  ^ 

detT  =  1  .  (11) 


Conversely,  given  an  arbitrary  orthogonal  transformation  T  with  matrix  elements  tij , 
i,j  =  1,  2,  3,  one  may  deduce  three  Euler  angles  that  completely  parametrise  T  as  follows, 

cp  =  arctan(ti2/tii)  (quadrant  determined  by  signs  of  <12  and  tn)  , 

9  =  -arcsin(ti3)  (9  g  [_7r/2, 7r/2]  ,  (12) 

ip  =  arctan(t23/^33)  (quadrant  determined  by  signs  of  ^23  and  <33)  . 

The  very  same  orthogonal  transformation  is  equally  well  parametrised  by  another  set  of 
Euler  angles  for  which  6  G  [x/2,  37r/2]. 

To  the  extent  that  the  landscape  is  planar  on  the  macroscopic  scale,  even  though 
on  the  microscopic  scale  the  topography  may  be  quite  rough,  it  is  possible  to  define  an 
object  plane  of  best  fit.  A  standard  object  space  frame  of  reference  0{x,  y,  z)  is  arbitrarily 
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defined  to  have  its  origin  at  the  centre  of  the  entrance  pupil,  with  its  z-axis  normal  to,  and 
pointing  towards,  the  object  plane.  It  follows  that  the  a:j/-plane  is  parallel  to  the  object 
plane.  Frame  O  is  denoted  the  cardinal  frame  of  reference. 

Reference  frame  0o(a;o,  yo,  •2^0)  is  aligned  along  the  initial  optical  system  orientation,  in 
particular,  the  zo-axis  is  the  initial  optical  axis.  The  orientation  of  frame  Oq  with  respect 
to  frame  O  is  specified  by  the  Euler  angle  values  ^0  and  ^q.  From  (8),  the  coordinate 
transformation  from  O  to  Oq  is, 

ro  =  Tor  ,  (13) 

where. 

To  =  T(<^0j  ^0)  t/^o)  •  (14) 

Similarly,  reference  frame  0\{x\,  y\,  Z\)  is  aligned  along  the  final  optical  system  orien¬ 
tation,  in  particular,  the  zi-axis  is  the  final  optical  axis.  The  orientation  of  frame  0\  with 
respect  to  frame  O  is  specified  by  the  Euler  angle  values  <?!)i,  61  and  ^1.  From  (8),  the 
coordinate  transformation  from  O  to  Oi  is. 


ri  =  Tir  ,  (15) 

where, 

Ti  =  T((/ii,  01,  V'l)  •  (16) 

Transforming  in  turn  from  frame  Oo  to  frame  O  and  then  from  frame  O  to  frame  0\ , 
one  obtains  the  transformation  of  object  space  coordinates  from  Oq  to  Oi,  that  is,  from 
the  initial  optical  system  orientation  to  the  final  optical  system  orientation: 


Tl  —  ToiTo  ,  (17) 

where, 

Toi  =  TiTJ  .  (18) 

Orthogonality  condition  (10)  has  been  invoked  in  obtaining  (18). 

Toi  is  also  a  proper  orthogonal  transformation;  that  is,  it  represents  a  single  rotation. 
In  particular,  Tqi  is  the  effective  rotation  that  can  displace  the  optical  system  from  its 
initial  orientation  to  its  final  orientation  (regardless  of  the  actual  trajectory  of  the  op¬ 
tical  system  in  accomplishing  its  displacement).  Consequently,  Tqi  must  be  completely 
parametrised  by  the  effective  Euler  angles  0oi  and  ipoi,  determined  from  its  matrix 
elements  according  to  (12). 

Although  transformation  Tqi  may  be  effected  without  recourse  to  subsidiary  transfor¬ 
mations  To  and  Ti,  the  utility  of  introducing  To  and  Ti  will  become  evident  in  Section  7. 
As  an  alternative  to  the  rotation  matrix  Toi,  the  direct  transformation  of  polar  coordi¬ 
nates  ensuing  from  a  rotation  of  the  reference  frame  may  be  expressed  by  the  equations 
in  Appendix  A. 
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4  General  image  warping 


An  optical  system  whose  only  aberration  is  distortion  will  project  stigmatic  images  of 
a  scene  that  are  distorted  compared  with  any  projective  transformation  of  the  scene.  If 
the  optical  system  is  moving,  there  is  also  a  temporal  variation  of  the  image  of  an  essen¬ 
tially  constant  scene.  This  image-to-image  spatial  and  amplitude  variation  constitutes  the 
image  warping  that  is  of  particular  interest  in  this  exposition.  The  distinction  between 
distortion  and  warping  is  that,  whereas  the  former  is  present  in  a  single  image  due  to  lens 
aberration,  the  latter  is  fundamentally  a  property  of  a  sequence  of  images.  Distinguish¬ 
ing  between  distortion  and  warping  in  this  manner  facilitates  discussion  by  eliminating 
ambiguity  between  these  two  concepts. 

The  warping  between  images  projected  ‘before’  and  ‘after’  an  optical  system  displace¬ 
ment  can  be  expressed  algebraically  as  follows.  Define, 


(a;o,?/o) 

«o(a;o,yo) 

(a:i,?/i) 


points  on  the  initial  image  plane  , 
initial  image  intensity  distribution  , 
points  on  the  final  image  plane  , 
final  image  intensity  distribution  . 


(19) 


One  is  cautioned  that  the  term  ‘image  intensity’  denotes  the  image  function  value  (ie. 
amplitude,  grey  level  or  brightness),  and  is  not  in  accordance  with  the  strict  definition 
of  intensity  adopted  in  radiometry;  in  fact,  image  intensity  actually  is  the  irradiance  of 
radiometry,  as  acknowledged  in  (45).  The  geometric  transformation  from  the  initial  image 
plane  to  the  final  image  plane  has  the  general  form. 


Xi  =  Xoi{xo,yo)  , 

yi  =  >oi(a;o,yb)  , 


(20) 


which  may  be  regarded  as  a  vector  field  in  the  The  radiometric,  or  intensity, 

transformation  from  the  initial  image  plane  to  the  final  image  plane  has  the  general  form. 


s\{x\,yi)  =  R{xo,yQ,xi,y{)S(i{xo,yQ)  ,  (21) 

which  may  be  regarded  as  a  scalar  field  in  the  xoj/Q-plane. 

Note  that  R  in  (21)  is  implicitly  a  function  of  only  (xo,yo),  since  (xi,yi)  is  com¬ 
pletely  determined  by  (xq,  j/q)  according  to  (20);  therefore  R  often  will  be  simply  expressed 
as  i?(xo,2/o)-  Note  also  that  (21)  implies  that  a  general  radiometric  transformation  is 
completely  determined  by  the  positions  in  the  image  planes,  regardless  of  illumination 
conditions,  or  reflection  and  emission  directional  characteristics  of  the  object  surface.  The 
extent  to  which  this  is  so  will  be  investigated  in  Sections  6  and  7.  The  intensity  linearity 
of  image  formation  (assuming  the  use  of  only  linear  optical  elements)  is  reflected  in  the 
form  of  (21),  by  the  fact  that  R  does  not  depend  on  sQ)  so  that  final  image  intensities 
are  simply  proportional  to  initial  image  intensities.  Substitution  of  (20)  into  (21)  entirely 
specifies  the  most  general  physically  allowable  point  transformation  that  quantifies  the 
image  warping  between  two  images  of  the  same  scene. 

Of  particular  interest  in  this  report  is  the  special  case  of  the  two  images  being  those 
projected  by  an  optical  system  before  and  after  a  rotation.  In  this  circumstance,  the  image 
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warping  is  uniquely  specified;  exactly  how  will  be  revealed  in  Section  5  for  the  geometric 
component  of  the  warping,  and  Section  6  for  the  radiometric  component  of  the  warping. 
Modifications  and  complications  to  the  pure  rotation  case  that  arise  on  inclusion  of  a 
simultaneous  translation  will  be  detailed  in  Section  7. 


5  Geometric  warping  due  to  optical  system 

rotation 


Geometric  warping  in  sequences  of  undistorted  images  is  frequently  studied  by  imaging 
science  researchers,  albeit  in  a  diversity  of  contexts.  Merchant  [12]  addresses  geometric 
warping  of  undistorted  images  due  to  arbitrary  camera  displacement,  in  a  context  similar 
to  the  research  that  has  motivated  this  report.  Geometric  warping  in  pairs  of  undistorted 
images  is  also  the  essence  of  the  relative  oneniaiion  problem  of  photogrammetry  (Horn  [13, 
14]),  which  is  actually  the  inverse  problem  to  the  one  of  interest  here.  Solving  the  relative 
orientation  problem  entails  deducing  the  camera  displacement  from  specified  geometric 
warping  between  two  undistorted  images.  In  the  present  report  one  considers  the  problem 
of  deducing  the  geometric  warping  resulting  from  specified  camera  displacement;  and  doing 
so  for  arbitrarily  distorted  images,  that  is,  for  an  arbitrary  imaging  characteristic  F{6). 

Specification  of  the  geometric  warping  (20)  is  communicated  with  greatest  clarity  by 
the  following  algorithm,  rather  than  a  self-contained,  but  complicated,  equation.  Never¬ 
theless,  the  closed  form  solution  for  geometric  warping  is  stated  in  Appendix  A  without 
derivation. 

Step  1.  The  initial  image  plane  point  (a;o,yo)  is  expressed  in  plane  polar  coordi¬ 
nates  (po)  cto), 

Po  =  {xl  +  vlf^  ,  ^22) 

tto  =  arctan(j/o/a^o)  (quadrant  determined  by  signs  of  j/o  and  xq)  .  ^  ’ 

Step  2.  Identify  the  point  in  object  space  that  is  conjugate  to  image  point  (a;o,j/o). 
This  object  space  point  has  spherical  polar  coordinates  (tq,  Oq,  <Pq)  with  respect  to  refer¬ 
ence  frame  Oo,  which  has  its  z-axis  aligned  along  the  initial  optical  axis,  and  its  origin  at 
the  centre  of  the  initial  entrance  pupil.  The  axial  symmetry  property  of  the  optical  system 
unambiguously  determines  the  azimuthal  angle  (po,  and  the  particular  imaging  character¬ 
istic  uniquely  determines  the  polar  angle  ^q.  However,  the  radial  distance  ro  is  determined 
by  the  topography  of  the  scene,  which  will  not  be  specified  for  the  present.  One  obtains, 

ro  =  r  , 

^0  =  F~^{po)  ,  (23) 

<f>0  =  tto  • 

r  is  the  unspecified  distance  between  the  optical  system’ and  the  object  point.  F~^  is  the 
inverse  function  of  F,  that  is,  the  inverse  imaging  characteristic,  and  is  unambiguously 
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defined  since  F  is  a  one-to-one  function.  For  the  ‘fish  eye’  imaging  characteristic  (4),  one 
obtains, 

F~^{p)  =  yp  (fish  eye  lens)  .  (24) 

The  cartesian  coordinates  of  the  object  point  (xq,  j/q,  Zq)  in  frame  Oq  are, 

Xq  =  ro  sin^o  cost^o  , 

Vq  =  ro  sin^o  sin?io  ,  (25) 

Zq  —  rocos^o  ■ 

For  present  purposes,  primed  cartesian  coordinates  represent  object  space  points,  and 
unprimed  cartesian  coordinates  the  conjugate  image  plane  points. 

Step  3.  The  cartesian  coordinates  of  the  invariant  object  space  point  in  the  rotated 
frame  of  reference  Oi,  which  has  its  z-axis  aligned  along  the  final  optical  axis,  and  its 
origin  at  the  centre  of  the  final  entrance  pupil  (which  coincides  with  the  origin  of  Oq  for 
pure  rotation),  are  given  by  linear  transformation  (18), 


- 1 

_ 1 

1 - 

1 _ 

y[ 

=  Toi 

y'o 

[  . 

[  4  J 

Converting  cartesian  coordinates  (xj,  i/j,  z[)  to  spherical  polar  coordinates  (r^,  6i,  (pi)  with 
respect  to  reference  frame  Oi,  one  obtains, 

_j_  yi2  _j_  ^i2y/2 

di  =  arctan[(xf  -f-  yiY^'^/z\]  £  [0,  tt]  ,  (27) 

01  =  arctan(j/j/xj)  (quadrant  determined  by  signs  of  y[  and  x\)  . 

Note  that  the  orthogonality  property  of  transformation  Tqi,  together  with  (23),  ensures 
that  for  pure  rotation, 

^1  =  ^0  =  ^  (pure  rotation)  .  (28) 

Examination  of  (23),  (25),  (26)  and  (27)  in  sequence,  reveals  that  neither  6i  nor  0i  depend 
on  r.  This  condition  is  a  result  of  the  absence  of  camera  translation;  camera  displacement 
is  being  restricted  to  pure  rotation  for  the  present.  For  a  slow  moving  or  high  altitude 
camera  platform  (ie.  aircraft),  or  a  particularly  unsteady  one,  the  contribution  of  rotation 
to  image  warping  dominates  that  of  translation;  so  one  is  considering  a  realistic  scenario 
in  the  present  exposition. 

Step  4.  Identify  the  final  image  plane  point,  with  plane  polar  coordinates  (/9i,q:i), 
that  is  conjugate  to  the  invariant  object  space  point.  One  directly  obtains  from  (1)  and  (2), 


/>!  =  F{e,) 

Oi  =  01  . 


(29) 


In  particular,  the  fish  eye  imaging  characteristic  (4)  is, 

F{0)  —  f9  (fish  eye  lens)  . 


(30) 
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The  final  image  plane  point  cartesian  coordinates  (xi,  j/i)  are, 


Xi  =  Pi  cosai  , 
yi  =  pisinai  . 


(31) 


Since  it  has  already  been  established  that  neither  9i  nor  (^i  depend  on  r,  it  follows  from  (29) 
that  the  final  image  plane  point  does  not  depend  on  r  either.  In  summary,  for  the  case  of 
camera  displacement  being  pure  rotation,  the  geometric  warping  from  the  initial  to  final 
image  plane  is  completely  independent  of  the  scene  topography. 

Steps  1  to  4  constitute  the  algorithm  for  evaluating  the  geometric  image  warping  (20) 
resulting  from  pure  rotation  of  the  optical  system,  for  specified  image  distortion  F{6) 
and  arbitrary  object  surface  topography.  For  presentation  purposes,  it  is  preferable  to 
consider  the  geometric  warping  as  being  the  displacement  between  the  image  points  that 
are  conjugate  to  the  same  object  point  for  the  initial  and  final  camera  orientation,  that  is. 


9x  =  xi-xo  , 

g'y  =  yi-yo  ■ 


(32) 


Since  (xj,  j/i)  is  a  function  of  (xq,  j/o),  the  geometric  warping  is  a  vector  field  in  the  initial 
image  plane,  expressed  as  (^'^(aio,  t/o),  ffy(a:o,  2/o))- 


It  is  best  to  exclude  global  image  translation  from  geometric  warping;  since  pure  image 
translation  does  not  conform  to  one’s  common  notion  of  warping  (ie.  there  is  no  difference 
in  the  appearance  of  the  images),  and  also  because  evaluation  of  the  translation  is  a  simple 
and  well  understood  ‘standard’  problem,  from  the  perspectives  of  analysis,  algorithms  and 
hardware  implementation  (the  solution  being  based  upon  the  cross  correlation  operation). 
One  achieves  this  by  subtracting  the  arbitrary  global  image  translation  {q^,  Qy)  from  the 
geometric  warping,  and  optimising  parameters  and  qy  according  to  the  least  squares 
criterion: 


minimum 
Qx:  Qy 


j  j  yo),g'y{^Q,  2/o))  -  {Qx,  qy)f  dxo  dyo  . 


complete 

image 


(33) 


The  solution  of  (33)  is  the  image  translation  that  best  approximates  the  actual  geometric 
warping  in  the  least  squares  sense: 


Qx 


Qy 


1 

Area 


?i(2:o.J/o)  dxo  dyo 


complete 

image 

aL  /A;(*o,  »)  dx„  dso 

complete 

image 


(34) 


The  interpretation  of  (34)  is  that  the  optimum  global  image  translation  is  just  the  spatial 
average  of  the  geometric  warping  vector  field;  which  is  an  intuitive  result. 

One  defines  the  most  appropriate  geometric  warping  vector  field  {gx,gy)  by, 


9x  —  ^1  ^0  Qx  J 

Qy  =  Vl-VO-Qy  ’ 


(35) 
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The  geometric  warping  represented  by  (35)  is  not  quite  the  intrinsic  geometric  warping, 
representing  only  the  non-shape-preserving  component  of  the  geometric  transformation, 
since  (35)  still  includes  global  image  rotation.  One  may  quantify  the  severity  of  the 
geometric  warping  by  its  root  mean  square  value. 


9nMS  — 


\  1/2 


Area 


||(ffa:(a:o,  yo),  gy{xo,  yo))|P  dio  dyo 


complete 

image 


y 


(36) 


An  actual  example  of  the  geometric  warping  vector  field  {9x,gy)  is  illustrated  in  Fig¬ 
ure  4.  In  this  example,  the  optical  system  has  the  fish  eye  imaging  characteristic  (4), 
as  illustrated  in  Figure  2.  The  angular  field  of  view  is  20inax  =  144°,  where  ^max  is  the 
field  angle  conjugate  to  any  of  the  vertices  of  the  square  image.  Parameter  /  in  (4)  is 
chosen  so  that  the  image  vertices  have  cartesian  coordinates  (±1,±1).  The  optical  sys¬ 
tem  angular  displacement  is  parametrised  by  the  Euler  angle  values  (^oi  =  4°,  0oi  =  -5° 
and  ^01  =  -7°,  as  discussed  in  Section  3.  Since  this  example  corresponds  to  pure  cam¬ 
era  rotation,  the  geometric  warping  vector  field  is  completely  independent  of  the  actual 
scene  and  its  topography.  A  global  image  translation  of  {q^;,  Qy)  =  (0.09,  —0.12)  units  has 
been  excluded  from  the  geometric  warping  vector  field.  The  root  mean  square  geometric 
warping  is  ^rms  =  0.057  units. 

Inspection  of  Figure  4  reveals  that  the  geometric  warping  vector  field  has  a  clockwise 
circulation  that  may  be  partially  removed  by  excluding  an  appropriate  global  image  rota¬ 
tion.  However,  it  is  evident  that  one  can  not  account  for  the  totality  of  geometric  warping 
by  only  proper  shape-preserving  image  tranformations  (ie.  translation  and  rotation,  but 
not  reflection).  There  is  an  intrinsic  geometric  warping  present  that  represents  change  of 
shape.  Inspection  of  Figure  4  also  suggests  that,  generally,  geometric  warping  increases 
with  increasing  field  angle  9.  This  conclusion  follows  from  the  observation  that  geometric 
warping  generally  tends  to  increase  with  distance  from  the  optical  axis  (ie.  image  centre). 

A  common  approach  to  the  registration  of  two  mutually  warped  images  of  the  same 
scene,  is  to  isolate  a  small  region  in  one  image,  and  maximise  the  cross  correlation  of 
the  second  image  with  this  small  region  (see,  for  example,  Pritt  [15]).  This  technique  is 
termed  block  matching  in  image  registration.  The  justification  for  this  approach  is  that 
the  geometric  warping  in  a  small  region  is  very  approximately  a  local  translation,  since 
other  terms  in  the  Taylor  series  expansion  are  not  too  large.  Different  regions  will  have 
different  local  translation  vectors.  The  present  analysis  allows  one  to  quantify  the  benefits 
of  this  approach. 

Figure  5  illustrates  the  geometric  warping  vector  field  for  identical  parameter  values 
to  those  of  Figure  4.  The  difference  is  that  in  Figure  5  the  image  is  partitioned  into  4x4 
subimages  of  equal  size,  and  the  geometric  warping  in  each  subimage  is  ‘corrected’  for  its 
own  subimage  translation.  Different  subimages  have  different  optimal  translations.  The 
geometric  warping  fields  of  Figures  4  and  5  are  otherwise  identical. 

Comparison  of  Figures  4  and  5  certainly  does  verify  that  operating  on  small  image 
segments  reduces  the  severity  of  geometric  warping.  A  quantitative  indication  of  this  is 
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Figure  4'-  Geometric  warping  vector  field  {gj;,  gy)  for  the  imaging  characteristic  of 
Figure  2,  the  indicated  field  of  view,  and  camera  rotation  according  to  the  indicated  Euler 
angles.  The  displayed  geometric  warping  excludes  a  global  image  translation  component 
0/ (0.09, —0.12)  units.  The  root  mean  square  value  of  the  geometric  warping  also  is 
indicated. 
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0=:-5°,  4j=-7°,  fov-144' 


,=0.016. 


Figure  5:  Geometric  warping  vector  field  {gx,gy)  for  the  imaging  characteristic  of 
Figure  2,  the  indicated  field  of  view,  and  camera  rotation  according  to  the  indicated  Euler 
angles.  The  image  is  partitioned  into  4x4  subimages,  each  of  which  has  its  own  particular 
translation  excluded  from  the  displayed  geometric  warping.  The  root  mean  square  value  of 
the  geometric  warping  also  is  indicated.  Compare  with  Figure  4- 
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conveyed  by  comparing  the  root  mean  square  geometric  warping  values:  ^rms  =  0.057  for 
the  unsegmented  image,  and  g^us  —  0.016  for  the  segmented  image.  Inspection  of  Figure  5 
suggests  that  the  geometric  warping  in  individual  image  segments  may  be  significantly 
diminished  by  also  correcting  for  image  segment  rotation.  Thus,  at  least  for  this  example, 
the  intrinsic  (non-shape-preserving)  geometric  warping  for  the  segmented  image  is  much 
smaller  than  that  for  the  unsegmented  image. 


6  Radiometric  warping  due  to  optical  system 

rotation 

In  contrast  to  geometric  warping,  radiometric  warping  seems  to  attract  relatively  lit¬ 
tle  attention  in  the  imaging  science  research  literature.  To  some  extent  this  neglect  is 
justifiable.  Many  applications,  such  as  navigation  of,  or  manipulation  by,  robots,  only 
require  knowledge  of  the  displacement  of  image  points  as  the  camera  moves,  to  infer  the 
changing  disposition  of  object  space  with  respect  to  the  camera.  The  fact  that  the  intensi¬ 
ties  of  the  image  points  conjugate  to  a  given  object  point  change  over  time  is  immaterial. 
Even  if  radiometric  warping  is  important  in  principle,  such  as  for  addition  or  subtraction 
of  images,  it  will  be  verified  below  that  radiometric  warping  becomes  significant  only  at 
larger  field  angles  (0>2O°).  Since  many  imaging  systems  have  a  relatively  narrow  field 
of  view  (20inax£2O®),  the  influence  of  radiometric  warping  on  images  often  is  marginal. 
Indeed,  in  such  a  case  the  intensity  variations  between  images  may  be  predominantly  due 
to  temporal  noise  and  focal  plane  detection  nonuniformity,  rather  than  radiometric  warp¬ 
ing.  However,  this  report  specifically  considers  wide  field  of  view  imaging,  in  which  case 
radiometric  warping  may  be  significant,  as  will  be  demonstrated  below. 

One  construes  from  (21)  that  radiometric  warping  is  the  intensity  ratio  of  final  ami 
initial  image  plane  points  that  are  conjugate  to  the  same  object  space  point.  In  the  case  of 
pure  camera  rotation,  where  the  optical  path  from  the  object  point  to  the  entrance  pupil 
of  the  camera  is  invariant,  atmospheric  nonuniformity  and  range  variation  can  have  no 
influence  on  the  radiometric  warping.  Rather,  the  physical  causes  of  radiometric  warping 
(and  indeed,  distortion)  are  all  due  to  variations  with  field  angle  of  both  the  radiant  energy 
flux  propagating  through  the  optical  system,  and  the  distribution  of  this  flux  on  the  focal 
plane.  One  is  cautioned  that  the  term  ‘radiometric  distortion’  is  sometimes  used  by  remote 
sensing  researchers  to  describe  the  manifestations  of  changing  optical  path  through  the 
atmosphere,  or  temporal  changes  in  the  propagation  of  light  along  a  given  optical  path. 
Other  researchers  define  radiometric  distortion  to  be  the  variation  of  detector  sensitivity 
over  the  focal  plane.  Both  of  these  usages  are  quite  distinct  from  the  ones  adopted  in  this 
report  for  either  distortion  or  warping. 

For  any  differential  element  of  area  on  the  image  plane,  one  seeks  the  conjugate  element 
of  area  on  the  surface  of  the  object  (eg.  the  ground).  Consider  an  infinitesimal  annular  arc 
in  the  image  plane,  with  centre  of  curvature  at  the  origin  and  position  (p,  a)  expressed  in 
plane  polar  coordinates  (refer  to  Figure  6).  The  area  of  this  differential  element  of  image 
plane  is, 

da  =  pda  dp  .  (H7) 
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Figure  6:  Conjugate  differential  elements  of  area  in  the  image  plane  (Aa),  and  on  the 
surface  of  the  object  (dA).  |dA  r|  is  the  magnitude  of  the  projection  of  the  element  of 
object  surface  area  along  the  radial  direction.  Snp  is  the  area  of  the  entrance  pupil  of  the 
optical  system;  in  general  Snp  depends  on  field  angle  6.  The  chief  ray  is  shown  tapered, 
and  the  marginal  rays  by  doited  lines. 
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Substituting  terms  depending  on  only  the  object  space  polar  and  azimuthal  angles  (6,  (p) 
for  terms  on  the  right  side  of  (37),  according  to  (1)  and  (2),  one  obtains  the  relation, 

d0  and  d<^  are  both  assumed  to  be  positive  without  loss  of  generality.  The  element  of  solid 
angle  in  object  space  that  is  conjugate  to  da  in  the  image  plane  is, 

dQ  =  sin0  d0  d(/i  ,  (39) 


which,  upon  substitution  of  (38),  becomes, 

sin^da 
^  F{d)  F’{e) 


(40) 


Let  the  object  surface  at  angular  position  {0,  (p)  be  at  distance  r  from  the  origin  (ie. 
centre  of  the  entrance  pupil);  spherical  polar  coordinates  thus  being  (r,  6,  <p).  If  dA  is  the 
differential  element  of  directed  area  on  the  object  surface  that  is  conjugate  to  da  in  the 
image  plane,  then  the  projection  of  dA  along  the  radial  direction  r  is  (refer  to  Figure  6), 

dAf=— r^dO  ,  (41) 


where  the  negative  sign  reflects  the  fact  that  if  the  element  of  object  surface  is  visible  from 
the  origin,  then  the  projection  of  its  outward  normal  along  the  radial  direction  must  be 
towards  the  origin.  Substitution  of  (40)  into  (41)  yields. 


_  sin^  da 

“  “  Fie)  F'{0) 


(42) 


It  is  noteworthy  that  this  analysis  is  valid  for  a  general  object  surface  topography;  the 
object  surface  is  not  constrained  to  be  planar.  This  generality  is  maintained  for  llie 
remainder  of  the  analysis,  despite  other  restrictions  being  imposed  to  facilitate  analytical 
development. 

One  seeks  the  radiant  flux  that  is  emitted,  scattered  or  reflected  from  object  surface 
element  dA  and  is  incident  upon  its  conjugate  image  plane  surface  element  da,  after 
propagation  through  the  optical  system.  In  this  report  the  term  ‘emission’  often  will  be 
interpreted  as  also  encompassing  scattering  and  reflection. 

For  radiation  collection  purposes,  the  optical  system  is  entirely  represented  by  its 
entrance  pupil.  However,  for  a  general  axially  symmetrical  optical  system,  the  shape, 
area,  position  and  orientation  of  the  entrance  pupil  all  vary  with  field  angle  0]  even  in  the 
absence  of  vignetting.  This  phenomenon  is  demonstrated  for  a  fish  eye  lens,  with  internal 
aperture  stop,  by  Kingslake  [6,  p.  87,88].  The  influence  of  entrance  and  exit  pupils  on 
the  illumination  properties  of  optical  systems  has  been  elucidated  by  the  careful  analyses 
of  Reiss  [16,  17],  Slussareff  [18]  and  Gardner  [19].  The  presence  of  vignetting  effectively 
causes  the  entrance  pupil  to  vary  even  more  rapidly  with  field  angle;  in  particular,  the 
entrance  pupil  area  diminishes  much  more  rapidly  with  increasing  0.  Aspects  of  vignetting 
in  wide  field  of  view  optical  systems  have  been  studied  by  Sands  [20]. 
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'lb  account  properly  for  the  variation  of  the  entrance  pupil  with  field  angle  for  a  general 
optical  system  is  a  formidable  undertaking,  and  in  some  respects,  a  digression  from  the 
main  theme  of  this  report.  Accordingly,  to  facilitate  the  present  analysis,  the  directed  area 
of  the  entrance  pupil  will  be  assumed  to  have  the  constant  value  5np  along  the  optical  axis 
at  all  field  angles  0.  An  optical  system  with  this  property  is  conceivable:  any  optical  system 
that  has  a  sufficiently  small  diaphragm  in  front  of  all  lens  elements,  small  enough  that 
the  diaphragm  remains  the  aperture  stop  at  all  field  angles,  with  all  lens  elements  having 
sulficicntly  wide  clear  apertures  to  prevent  vignetting  at  all  field  angles.  It  is  emphasised 
that  it  is  not  sufficient  for  the  entrance  pupil  to  be  in  front  of  all  lens  elements;  the  physical 
aperture  stop  must  also  be  so  positioned.  Such  an  optical  system  has  its  entrance  pupil 
coinciding  with  its  aperture  stop.  Consequently,  since  the  aperture  stop  is  a  mechanical 
entity,  it  follows  that  there  is  no  scope  for  the  entrance  pupil  to  vary  with  field  angle. 

One  is  cautioned  that  most  wide  field  imaging  systems  do  not  conform  to  this  pre¬ 
scription,  due  to  one  or  more  of  the  following  reasons;  the  presence  of  an  internal  aperture 
stop,  different  diaphragms  assuming  the  role  of  aperture  stop  in  different  field  angle  inter¬ 
vals,  and  the  presence  of  vignetting.  Nevertheless,  optical  systems  which  are  not  afflicted 
by  at  least  some  of  these  ‘problems’  have  been  devised.  The  fish  eye  lens  discussed  by 
Kingslake  [6,  p.  87,88]  maintains  the  same  (internal)  aperture  stop  at  all  field  angles,  and 
it  is  never  subject  to  vignetting,  not  even  at  large  field  angles.  Wide  field  of  view  lenses 
with  the  aperture  stop  positioned  in  front  of  all  lens  elements  have  been  designed  by  Du- 
dragne  [21]  and  Yasukuni  [22].  The  analytical  expressions  for  radiometric  distortion  and 
wa.ri)ing  that  will  be  derived  in  this  section  will  admittedly  only  pertain  to  an  idealised, 
hypothetical,  but  conceivable,  optical  system;  but  the  underlying  reasoning  leading  to 
its  derivation  is  precisely  that  which  would  have  to  be  invoked  for  any  practical  optical 
system. 


One  infers  from  Figure  6,  that  the  solid  angle  subtended  by  the  entrance  pupil  at  a 
distant  object  point  with  spherical  polar  coordinates  (r,  6,  (j))  is, 


rinp  — 


Snp  COs6 

r2 


(43) 


Equation  (43)  assumes  that  the  object  point  distance  r  is  sufficiently  large  for  the  marginal 
rays  to  be  parallel  to  the  chief  ray,  or  equivalently,  that  the  radius  of  the  entrance  pupil  is 
much  smaller  than  r.  Under  any  practical  conditions,  this  assumption  definitely  is  valid. 
The  radiant  flux  emanating  from  object  surface  element  dA  that  is  collected  by  the  optical 
system  is, 

d$e  =  Ee(x,  -r)  [dA--r]  finp  ,  (44) 

where  Le(x,  — r)  is  the  radiance  of  the  object  surface  at  surface  location  x  and  in  direc¬ 
tion  — r  (recall  that  r  is  the  unit  vector  from  the  centre  of  the  entrance  pupil  to  the  object 
point). 


Neglecting  the  occurrence  of  absorption,  scattering  and  reflection  of  light  within  the 
optical  system,  all  of  the  radiant  flux  d$e  impinges  upon  the  image  plane  area  that  is  con¬ 
jugate  to  dA,  that  is,  da  of  (37),  as  illustrated  in  Figure  6.  The  image  plane  irradiance  Eg, 
which  is  the  most  appropriate  measure  of  image  intensity  s,  becomes  by  (44), 

d  d  ’  ■”  r 

s  =  E,  =  —  =  Le(x,  -r)  finp  .  (45) 
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which,  upon  substitution  of  (42)  and  (43),  becomes  for  an  object  point  at  infinity, 


^e(x. 


sin2^ 

F{e)  F'{e) 


(46) 


Inspection  of  (46)  reveals  that  the  image  plane  irradiance  is  independent  of  the  object 
distance,  as  long  as  that  distance  is  large.  This  behaviour  is  due  to  the  combination  of 
an  dependence  of  the  element  of  object  surface  area  conjugate  to  a  given  image  plane 
area,  and  an  inverse  dependence  of  the  solid  angle  subtended  by  the  entrance  pupil  at 
the  object  point.  An  optical  system  that  exhibits  no  distortion  aberration  has  the  imaging 
characteristic  (3),  for  which  (46)  yields  the  image  plane  irradiance  variation, 

Ee  =  ---  ^  cos'*0  (perfect  imaging)  .  (47) 

Thus,  a  ‘perfect’  imaging  system  has  no  geometric  distortion,  but  it  does  have  the  radio- 
metric  distortion  of  (47).  If  the  geometric  distortion  is  described  by  imaging  characteris¬ 
tic  (4),  then  the  image  plane  irradiance  varies  as, 

^  5npi.e(x, -r)  sin20  ,  . 

Ee  = - - ^  (actual  imaging)  ,  (48) 

indicating  the  presence  of  radiometric  distortion.  In  (47)  and  (48),  6  is  the  angle  between 
the  object  point  and  optical  axis  measured  at  the  centre  of  the  entrance  pupil.  Both  (47) 
and  (48)  are  consistent  with  a  contention  of  the  opening  paragraph  of  this  section — tliat 
radiometric  distortion  and  warping  only  tend  to  become  significant  at  larger  field  angles. 

Expression  (46)  for  the  irradiance  variation  over  the  image  plane  has  been  previously 
derived  by  Reiss  [17]  and  Kingslake  [23,  Section  5. III. 7],  for  the  more  restricted  case  of  a 
planar  object  surface  oriented  normally  to  the  optical  axis.  The  present  derivation  is  much 
simpler,  although  it  is  not  amenable  to  generalisation  to  the  case  of  a  varying  entrance 
pupil  with  obliquity  (which  would  be  the  situation  for  a  non-frontal  aperture  stop  or 
vignetting),  nor  to  a  finite  object  distance.  Such  generalisations  are  encapsulated  in  the 
formal  analyses  of  Reiss  [16,  17],  Slussareff  [18]  and  Gardner  [19].  The  present  derivation 
is  distinguished  by  the  absence  of  any  assumption  about  the  topography  of  the  object 
surface  (provided  it  remains  at  infinity  everywhere);  hence  the  image  plane  irradiance 
variation  (46)  has  validity  beyond  the  planar  object  surface  normal  to  the  optical  axis  that 
has  been  assumed  in  previous  derivations.  It  is  important  to  establish  this  applicability 
to  all  object  surface  topographies,  since  if  the  object  is  a  realistic  landscape,  it  will  have 
very  many  inclined  facets. 

One  is  now  able  to  express  the  radiometric  warping  R{xo,  yo)  defined  by  (21)  in  terms 
of  the  imaging  characteristic  and  the  common  object  point  polar  angles  before  and  after 
displacement  of  the  optical  system: 


_  ^eijxuyi) 

^  so(xo,t/o)  E,o{xo,yo) 


(^19) 


Since  (a;i,j/i)  is  determined  from  (xo,yo)  according  to  the  geometric  transformation,  the 
radiometric  warping  is  a  scalar  field  in  the  initial  image  plane.  Substituting  (46)  into  (49) 
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yields  the  desired  expression  for  radiometric  warping  within  the  infinite  object  distance 
approximation, 


^(2:0,  yo) 


Le{x,  -ri)  sin2gi  F{eo)  F'{0o) 
Leix,  -fo)  sin20o  Fiei)  F'^)  ’ 


(50) 


where  the  0/1  subscript  signifies  quantities  measured  with  respect  to  the  initial/final  co¬ 
ordinate  system  (frame  Oq/Oi). 


For  the  present,  restrict  the  optical  system  displacement  to  be  pure  rotation,  as  done 
in  Section  5.  Since  f  specifies  the  direction  from  the  centre  of  the  entrance  pupil  to  the 
object  point,  neither  of  which  are  displaced  in  the  ‘world’  coordinate  system,  one  has, 

?i  =  ?o  (pure  rotation)  ,  (51) 

in  which  case  (50)  simplifies  to. 


,  _  sin2(?i  F(0o)  F'ieo) 

(P"'*  rotation)  .  (52) 

1  he  initial  and  final  field  angles  are  determined  by  the  geometric  warping  evaluation 
algorithm  of  Section  5;  Qo  emerging  at  (23)  in  the  algorithm,  and  emerging  at  (27). 
Inspection  of  (52)  confirms  that  the  radiometric  warping  RixQ,  yo)  does  not  depend  on  the 
illumination  conditions,  or  the  reflection,  scattering  and  emission  properties  of  the  object 
surface,  in  any  way.  This  verifies  the  contention  of  Section  4  for  the  case  of  pure  rotation. 
Furthermore,  since  it  has  been  determined  in  Section  5  that  the  mapping  of  Oq  to  6\  is  not 
influenced  by  the  ground  topography,  it  follows  from  (52)  that  the  radiometric  warping  is 
also  completely  independent  of  the  ground  topography,  for  pure  rotation. 

As  done  for  geometric  warping  in  Section  5,  it  is  most  appropriate  to  introduce  the 
intrinsic  radiometric  warping  scalar  field. 


usoixQ,  yo)  ''  > 

where  constant  parameter  u  is  to  be  optimally  chosen  as  indicated  below.  The  intrinsic 
radiometric  warping  vanishes  if  the  final  image  amplitudes  are  everywhere  the  same  mul¬ 
tiple  u  of  the  initial  image  amplitudes,  where  the  initial  and  final  image  points  are  related 
by  the  geometric  transformation.  This  is  a  desirable  property,  since  uniform  scaling  of  ini¬ 
tial  image  amplitudes  to  obtain  final  image  amplitudes  does  not  constitute  a  radiometric 
warping  in  the  colloquial  sense.  Substituting  definition  (49)  into  definition  (53)  yields, 


^in(a;o,  yo)  =  -7?(a;o,  yo)  -  1 

u 


(54) 


The  root  mean  square  intrinsic  radiometric  warping  is, 

/ 


^inRMS  (^) 


J I yo)  cla:o  dyo 

complete 

image  / 

—  ff(- 

Area  J  J  \u 

complete 


-^(aio,  yo)  -  1  )  dxodt/o 


\  1/2 

/ 


(55) 
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Parameter  u  is  optimised  according  to  the  least  squares  criterion, 


minimum  Rm^usi^)  >  (56) 

u 

whose  solution  is  the  optimum  uniform  scaling  for  the  initial  image  amplitude, 


u 


R^{xo,yo)  dio  dyo 


complete 

image 


'll 

mplet 


R{xo,yo)  diCo  dt/o 


'complete 

image 


(57) 


where  the  numerator  and  denominator  are  both  (almost)  certainly  non-zero,  since  the  non¬ 
negative  nature  of  image  intensity  ensures  that  R{xo,  ya)  >  0  everywhere.  The  severity 
of  the  intrinsic  radiometric  warping  may  be  quantified  by  the  minimum  of  its  root  mean 
square  value,  that  is,  by  72inRMs(“)- 

Figure  7  illustrates  the  intrinsic  radiometric  warping  scalar  field  iiin(a:o,  J/o)  for  identi¬ 
cal  optics  and  rotation  parameters  as  the  example  introduced  in  Section  5;  it  is  associated 
with  the  geometric  warping  vector  field  graphed  in  Figure  4.  Since  this  example  corre¬ 
sponds  to  pure  camera  rotation,  the  intrinsic  radiometric  warping  scalar  field  is  completely 
independent  of  the  actual  scene  and  its  topography.  The  initial  image  is  uniformly  scaled 
by  the  factor  u  —  1.0067,  and  the  ensuing  root  mean  square  intrinsic  radiometric  warp¬ 
ing  is  TJinRMs  ~  0.135  units.  Inspection  of  Figure  7  verifies  that  the  intrinsic  radiometric 
warping  is  most  extreme  on  some  portions  of  the  periphery  of  the  field  of  view,  although 
not  everywhere  on  the  periphery. 

Repeating  the  image  segmentation  exercise  of  Section  5  results  in  the  intrinsic  radio- 
metric  warping  scalar  field  illustrated  in  Figure  8,  in  which  a  separate  uniform  scale  factor 
is  applied  to  each  initial  image  segment.  The  associated  geometric  warping  vector  field 
is  the  one  graphed  in  Figure  5.  Apart  from  the  fact  that  different  segments  in  Figure  8 
have  different  optimal  initial  image  scalings,  the  radiometric  warping  fields  of  Figures  7 
and  8  are  otherwise  identical.  As  for  geometric  warping,  one  confirms  that  the  severity 
of  radiometric  warping  is  reduced  significantly  by  operating  on  small  image  segments: 
72inRMs  —  0.135  for  the  unsegmented  image,  and  Rihrms  ~  0.042  for  the  segmented  im¬ 
age.  However,  Figure  8  indicates  that  the  intrinsic  radiometric  warping  of  some  image 
segments,  in  particular  the  one  centred  at  (0.75,  —0.75),  is  still  quite  substantial.  This 
would  serve  to  frustrate  subimage  registration  by  cross  correlation;  a  more  sophisticated 
technique  may  be  necessary. 


7  Image  warping  due  to  arbitrary  optical  system 

displacement 

Sections  5  and  6  addressed  the  geometric  and  radiometric  image  warping  resulting 
from  pure  rotation  of  the  camera.  However,  an  arbitrary  rigid  body  displacement  is 
resolvable  into  two  operations  (Chasles’  theorem;  Goldstein  [11,  Sec.  4-6]):  rotation  about 
a  centre,  and  displacement  of  that  centre  (ie.  translation).  In  this  section,  one  examines 
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l|j=-7°,  fov-144'^ 


,=0.135 


Figure  7:  Intrinsic  radiometric  warping  scalar  field  ilin(®o,lto)  *«  the  initial  image  plane, 
for  the  imaging  characteristic  of  Figure  2,  the  indicated  field  of  view,  and  camera  rotation 
according  to  the  indicated  Euler  angles.  The  initial  image  amplitude  is  uniformly  scaled 
by  the  factor  1.0067.  Contour  spacing  is  A/2in=0.050  units,  symmetrically  disposed  about 
Rin  =  0,  with  negative  values  indicated  by  broken  lines  and  positive  values  by  continuous 
lines.  Contour  values  increase  monotonically  as  one  progresses  from  (1,-1)  to  (—1,1). 
The  root  mean  square  value  of  the  intrinsic  radiometric  warping  also  is  indicated. 
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0=4°,  6=-5°,  i|J=-7°,  fov=144°,  warp  i  001^1^2=0. 042  = 


Figure  8:  Intrinsic  radiometric  warping  scalar  field  Rinixo,yo)  in  the  initial  image  plane, 
for  the  imaging  characteristic  of  Figure  2,  the  indicated  field  of  view,  and  camera  rotation 
according  to  the  indicated  Euler  angles.  The  image  is  partitioned  into  4x4  subiinages, 
each  of  which  is  corrected  for  its  own  particular  mutual  scaling  betiveen  initial  and  final 
images.  The  root  mean  square  value  of  the  intrinsic  radiometric  warping  also  is  in¬ 
dicated.  Compare  with  Figure  7,  with  which  this  graph  shares  the  same  contouring  scheme. 
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how  the  preceding  analysis  is  modified  to  account  for  the  arbitrary  translation  vector  b 
from  the  initial  to  the  final  centre  of  the  entrance  pupil,  in  addition  to  the  camera  rotation. 
d'h(;  consequences  of  the  inclusion  of  camera  translation  will  be  elucidated,  although  no 
computational  results  will  be  presented. 

'IVanslation  vector  b  has  cartesian  coordinates  [b^,  by,  b^)  in  the  cardinal  reference 
frame  O  introduced  in  Section  3.  The  geometric  warping  algorithm  remains  essentially  as 
in  Section  5,  subject  to  the  extension  of  (26)  to  become, 


(58) 


where  Ti  is  the  rotation  matrix  from  frame  O  to  frame  Oi,  as  in  (16). 

Since  (58)  is  not  an  orthogonal  transformation,  because  of  the  translation  term,  the 
radial  distance  of  the  invariant  object  point  from  the  centre  of  the  entrance  pupil  changes 
with  camera  displacement,  that  is, 

n  7^  ^0  =  ^  (translation  and  rotation)  ,  (59) 

in  contrast  to  (28)  for  pure  rotation.  More  importantly,  the  direction  of  the  object  point  in 
frame  O],  as  expressed  by  angles  di  and  (f)i  of  (27),  now  does  depend  on  r.  Consequently, 
the  final  image  plane  point  that  emerges  in  Step  4  of  the  geometric  warping  algorithm 
now  does  depend  on  r.  This  implies  that  for  general  camera  displacement,  the  association 
of  an  initial  image  plane  point  with  a  final  image  plane  point  (ie.  the  geometric  warping) 
formally  depends  on  the  topography  of  the  object  surface  (eg.  ground). 

In  Section  6  the  direction  of  the  invariant  object  point  from  the  centre  of  the  entrance 
pupil  is  denoted  by  r;  since  the  centre  of  the  entrance  pupil  now  undergoes  a  displacement, 
this  direction  changes  between  reference  frames  Oq  and  Oi,  that  is, 

?!  ^  fo  (translation  and  rotation)  ,  (60) 

in  contrast  to  (51)  for  pure  rotation.  Therefore,  for  general  object  surface  radiance 
Le{x,  -f),  the  radiometric  warping  no  longer  simplifies  from  (50)  to  (52)  in  the  presence 
of  camera  translation.  Inspection  of  (50)  reveals  that  for  general  camera  displacement  and 
object  radiance,  the  radiometric  warping  depends  on  the  anisotropy  of  emission/scatter¬ 
ing/reflection  from  the  object  surface,  this  anisotropy  in  part  being  due  to  illumination 
conditions.  Such  behaviour  is  contrary  to  the  assertion  of  Section  4,  which  is  now  recog¬ 
nised  as  not  being  a  universal  principle. 

An  ideal  Lambertian,  or  diffuse,  source,  is  a  perfectly  isotropic  emitter,  for  which  the 
radiance  is  independent  of  direction,  that  is. 


Le(x,  — Fi)  =  Le(x,  — fq)  =  Le(x)  (Lambertian  source) 


(61) 


If  the  object  surface  is  a  Lambertian  emitter,  the  radiometric  warping  once  again  simplifies 
from  (50)  to  (52);  this  time  for  arbitrary  camera  displacement.  Thus,  one  has. 


Ri^o,  yo) 


sin2^i  Fi9o)  F'ido) 

sm2eoF(ei)F'(ei) 


(Lambertian  source; 
translation  and  rotation) 


(62) 
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and  one  concludes  that  a  Lambertian  object  surface  gives  rise  to  a  radiometric  warping  that 
is  independent  of  the  directionality  of  the  illumination,  and  the  unconstrained  reflection, 
scattering  and  emission  characteristics  of  the  surface,  for  an  arbitrary  camera  displacement. 
The  radiorr  etric  warping  resulting  from  a  Lambertian  object  surface  and  arbitrary  camera 
displacement  is  once  again  consistent  with  the  assertion  of  Section  4. 

Whether  the  radiometric  warping  is  described  by  (50)  or  (62),  it  depends  on  the  map¬ 
ping  between  Oq  and  0i.  It  has  been  established  in  this  section  that  this  mapping  is 
influenced  by  the  ground  topography  in  the  presence  of  camera  translation.  Consequently, 
the  radiometric  warping  implicitly  depends  on  the  ground  topography  for  general  cam¬ 
era  displacement,  even  for  Lambertian  emission;  Lambertian  emission  only  removes  the 
dependence  of  the  radiometric  warping  on  the  (isotropic)  radiance  of  the  surface. 


8  Conclusions 

It  is  conceptually  appealing  to  decompose  the  image  warping  arising  from  an  opti¬ 
cal  system  displacement  into  geometric  and  radiometric  components,  and  consider  them 
separately,  as  has  been  done  in  this  report.  However,  ultimately  the  two  components 
combine  according  to  (20)  and  (21)  to  yield  the  complete  initial  to  final  image  transfor¬ 
mation.  Schemes  for  approximating  the  geometric  and  radiometric  transformations  may 
be  devised.  For  example,  one  may  approximate  the  functions  A'oi(a;o,  ?/o)i  Foi(a;o,yo)  ^i-'id 
Ri^o,yo)  of  Section  4  by  polynomials  of  specified  orders;  which  may  be  chosen,  among 
other  ways,  by  truncating  the  power  series  expansion  of  the  exact  functions  beyond  a 
certain  number  of  terms. 

The  ultimate  arbiter  of  the  fidelity  of  the  approximations  is  the  discrepancy  betw(;en 
the  transformed  images  arising  from  approximate  and  exact  complete  transformation, s 
applied  to  the  same  initial  imge.  This  discrepancy  can  not  easily  be  ascertained  by  in¬ 
dividual  consideration  of  the  geometric  and  radiometric  components  in  isolation;  the  two 
transformation  components  operate  synergistically  in  warping  the  image.  Furthermore, 
the  discrepancy  between  transformed  images  depends  upon  the  initial  image  to  which 
the  transformations  are  applied,  even  though  the  transformations  themselves  are  image 
invariant  (for  pure  rotation). 

Although  ffaMs  (36)  and  /Iihrms  (35)  are  quantitative  measures  of  geometric  and  ra¬ 
diometric  warping,  the  most  meaningful  measure  would  actually  be  the  root  mean  square 
image  difference  (appropriately  normalised).  However,  unlike  jtrms  and  /?inRMs>  fl'e  value 
of  this  metric  depends  on  the  image  content  as  well  as  the  warping  between  initial  and 
final  images.  Different  object  space  distributions  give  different  warping  measures.  The 
most  representative  single  measure  of  warping  in  this  case  would  be  an  ensemble  average 
of  the  warping  measure  for  all  possible  object  distributions  of  interest.  Such  an  ensemble 
average  would  only  depend  on  the  warping  between  initial  and  final  images. 

The  ensemble  averaging  procedure  in  principle  requires  the  availability  of  a  large  en¬ 
semble  of  representative  background  images.  Equivalently,  one  can  use  a  valid  statistical 
model  of  the  background  random  field,  in  which  case  all  ensemble  averages  are  deducible 
from  the  joint  probability  density  function. 
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I  liis  report  has  elucidated  the  exact  solution  to  the  problem  of  image  registration  that 
arises  as  a  result  of  displacement  of  an  idealised  optical  system,  and  it  is  quite  reasonable 
to  expect  that  the  qualitative  features  of  the  solution  also  apply  to  any  practical  imaging 
system.  These  results  have  immediate  practical  utility  to  the  problem  that  inspired  the 
research  airborne  passive  missile  detection  by  differential  motion  observation,  as  reported 
by  Caprari  [1],  Simulations  of  the  magnitude  of  observed  differential  motion  of  missiles 
relative  to  the  background,  as  presented  in  [1],  indicate  that  differential  motion  is  quite 
small  compared  with  the  image  resolution  (i.e.  pixel  size)  and  absolute  motion  of  the  whole 
image  (due  to  aircraft  motion).  This  circumstance  emphasises  the  critical  importance  of 
achieving  precision  in  the  image  registration  step  of  the  differential  motion  determination. 
Research  presented  in  this  report  forms  the  theoretical  foundation  upon  which  a  practical 
precision  image  registration  system  would  need  to  be  based. 

An  incidental,  but  important,  result  of  this  research  is  the  demonstration  of  the  severity 
of  the  radiometric  distortion  towards  the  perimeter  of  a  wide  field  image.  A  practical 
implication  of  this,  is  that  any  image  processing  algorithm  that  utilises  image  intensity 
thresholding,  would  need  to  use  local  threshold  values  to  achieve  equally  reliable  operation 
across  the  complete  image. 
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Appendix  A 

Transformation  of  polar  coordinates  due  to 
rotation  of  reference  frame 


In  Section  5  the  geometric  transformation  due  to  optical  system  rotation  was  expressed  as 
a  four  step  algorithm.  An  alternative,  explicit  solution  of  this  problem  will  be  presented 
here  without  derivation.  For  brevity  of  expression,  what  is  presented  is  the  geometric 
transformation  from  object  point  polar  coordinates  (ro,  Oq,  (t>o)  in  initial  frame  Oo,  to  polar 
coordinates  of  the  same  object  point  in  rotated  frame  Oi.  To  complete  the 

image  plane  to  image  plane  geometric  transformation,  one  only  needs  to  include  the  simple 
relationships  between  object  space  polar  coordinates  and  image  plane  cartesian  coordinates 
that  are  stated  in  Section  5 — being  (22)  and  (23),  and  its  inverse,  (29)  and  (31). 

Denote  the  elements  of  the  rotation  matrix  from  Oo  to  Oi  by  tij,  i,j  =  1,2,3.  Then 
the  axis  of  rotation  (in  either  frame  Oq  or  Oi)  is  the  vector 


n 


^12^31  ~  ti3<21 
(1  —  tll)(t31  —  tl3)  , 
(1  —  ^ll)(tl2  —  t2l) 


and  the  unit  vector  in  the  direction  of  the  rotation  axis  is 


(Al) 


n 


Til 

«2 

ns 


The  angle  of  rotation  of  the  coordinate  system  about  axis  n  is 


=  arccos 


+  ^22  +  <33  ~ 


n  £  [0,  tt]  . 


(A2) 


(A3) 


Finally,  the  polar  coordinate  transformation  from  initial  frame  Oq  to  rotated  frame  Oi 
is 


ri  =  ro  , 

$1  =  arccos[n3(ni  sin^o  cos(/io  +  ^2  sin^o  sini^o  +  ^3  cos0o)(l  —  cosQ)+ 

(n2  sin^o  cos(po  —  ni  sin^o  sin^o)  sinD  +  cos^o  cosfi]  Oi  £  [0,  tt]  , 


<f>i 


arctan 


n2(ni  sin^o  cos(^o  +  n2sin^osin^o  +  n3cos&o)(l  —  cosD)+ 
(ni  cos^o  —  ns  sin^o  cos(/>o)  sinD  +  sin^o  sin(/io  cosQ 
ni(ni  sin^o  cos<po  +  ^2  sin^o  sin</)o  +  ns  cos0o)(l  —  cosD)+ 
(n3  sin^o  sin^o  —  «2  cos^o)  sinfi  +  sin^o  coscfiQ  cosfi 


(quadrant  determined  by  signs  of  numerator  and  denominator) 


(A4) 
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determining  the  transformation  of  the  irradiance  (i.e.  image  warping)  due  to  arbitrary  displacement  of  the  optical  system;  such 
image  warping  being  separable  into  geometric  (i.e.  image  point  shift)  and  radiometric  (i.e.  intensity  scaling)  components. 
Numerical  simulations  demonstrate  the  severity  of  the  radiometric  warping  for  wide  field  images-an  especially  important 
result,  since  radiometric  warping  is  conventionally  neglected  in  image  registration.  Exact  solutions  for  the  warping  due  to  pure 
rotation  of  an  idealised  imager  are  presented.  These  are  completely  independent  of  the  scene.  An  examination  of  the  inclusion 
of  imager  translation  shows  that  the  warping  becomes  formally  dependent  on  the  scene  topography,  and  emission/scattering 
directionality.  Simulations  of  the  use  of  block  matching  to  achieve  approximate  registration  are  presented. 
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